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As part of the overall study of the development of 
rioral objectives for preschool children, the three parts of this 
rfc discusses matching procedures, survey instruments, and 
Ling guidelines. Part C, Matching objectives and Recommendations 
Development of Measures, contains discussions of the following; A 
ling of Existing Measures to Behavioral objectives (Using the 
led List, and Matches) ; Recommendations for Further Development 
sasures for Determining Terminal Developmental Characteristics, 
appendixes; A, Abstract Sheet, B, Coding Guides, C. Directory of 
Lshers, and D. Supplementary Bibliography. Part D, Titles I and 
*rogram- Evaluation survey instruments; Scope and Design, 
asses the following topics; A Data Gathering Instrument (survey 
rogram in Early Childhood, SPEC), Integrating the SPEC into 
rams, strengths and Limitations of SPEC, Survey Requirements at 
- Levels, and Survey of Program in Early Childhood; for Title I 
IX Evaluation. Part E, Sampling Recommendations or Guidelines, is 
itematic presentation of guidelines for the sampling of cases, 
i is illustrated with a Figure titled " Sampling of Cases by 
is of the National Normative and Evaluation Studies. ” (For 
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page « location 

182 3 1st line of APELL-- should read "Three thousand experimental Ss were 
used . * * ,r 

206, "Behavior Check List 11 entry--Long shouleLbe (Lang, 1966) c 

216, 1 ’Minnesota Per c ep to - Diagno s t ic Scale^—is the correct spelling* 

Several pages--Science Research Association should read Science Research 
Associates, as is correct in Appendix C* 



1 0nly those errata are listed xdiich affect the sense of Part B or its 
usage* 
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INTRODUCTION 



Part C of the present report completes the section of the report 
begun in Parts A and B, adding to it an extra-contractual inclusion. 

The "Recommendations" portion constitutes the entirety of contractual 
Part C, All contractual features of Part B appeared in Report III(A-B). 
Appendices in the present report are, in any event, essentiai to the use 
of Report IIX B as well as Co Thus, the "Matching" section of the present 
report is not a contractual part of the overall project. It does, however, 
in our opinion add significantly to the overall report's usability in the 
field and ought for this reason be made available to users of the evaluation 
portions of the project's reports. 
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A MATCHING OF EXISTING MEASURES 
TO BEHAVIORAL OBJECTIVES 

This portion of the final report is a continuation of Report III. 

More extensiv remarks will be offered in the "Reecrnimendations" section 
about the conditions under which the matches made in this section could 
become more defensible* Short of implementing those recoxmendatians , many 
of the matches must be considered highly tentative* because the existing 
instruments may be appropriate to only a limited number of the demographic 
subgroupings of five year olds, with their validity unknown for other 
subgroups. Criterion referenced tests and special testing considerations 
are also discussed under "Recommendations 81 . 

The general format of this section is structured according to the 
coded listings of Appendix B, which were previously (see Report III) 
used to indicate, for the tests reviewed, their applicability to par- 
ticular behavioral characteristics. The current section is more extensive 
and definitive than were those briefer mentions of matching and effectively 
supercedes them. The only departures from the sequence of Appendix B 
will occur for those variables which were expanded or regrouped in Part A 
of Report III (see especially pages 136-138 for a summary list of ex- 
pansions and regroupings)* Appendix B willg, however, override the above 
summary list in the case of category deletions which occurred diring the 
preparation of specific objectives. Even though specific objectives were 
not* in those cases, justified from the research literature, acceptable 
measurement techniques may exist for examining the status of children. 

These are designated "No objective" to clarify their status from Report IIX S 
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To suiranarize these statements, Appendix B is the basis of this section's 
sequential format except for variables which were expanded or regrouped, 
as summarized in Report III, pages 136-138, Finally, subscripts are 
added to the Appendix B codes for the categories expanded in Part A of 
Report III. For example, for P-3 "Growth and Maturation" the first ex- 
panded subcategory, "Physical Measures" is coded P-3-1, 



Using the Matched List 

The convention used will be to Identify the characteristic by its 
coded designation, where P = Psychomotor, C = Cognitive, A = Affective, 
This is followed by the associated number from Appendix B, In the case 
of regroupings, all interrelated coded designations appear together. 
Immediately following this designation of the child characteristic, re- 
ference is made to assessment procedures from Part B of Report III, Cross 
reference to Part B is made to the list titles by the abbreviations* 

T =• "Test", ObP = "Observational Procedures", and TP = "Technical Pro- 
cedures", Further brief commentary may appear to indicate the range and 
limitations of the recommended assessment procedure(s) . When multiple 
measures are mentioned, any comments are interspersed in such a manner as 
to retain clearly the connection between comment and procedure. Given 
this sequential format, the user can quickly locate assessment procedures 
for the characteristic (s) of concern to him. Thus, we have traded off 
the elegance of narration for the utility of a list that guarantees rapid 
retrieval. The user who desires further information on a selected as- 
sessment procedure can then search the alphabetized T, ObP or TP list for 
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that entry 0 Reside the entry ha will find reference made to a supplier 
or basic source document (Appendices C and D) , 

The recommended assessment procedures will generally be slightly 
broader than the stated objectives, although the user can be assured 
regarding their general compatibility. What should be done to sharpen 
these matches appears within the 1 1 Recommend a t ions 1 1 chapter. Often available 
data permit no clear preferential discriminations between available devices. 
In these cases, multiple entries are provided. Since potential demographic 
subpopulations cannot be anticipated, in fact, for a document such as 
this which will be broadly distributed , it has almost always seemed a 
p ropes to provide the multiple entries, leaving the final selection to the 
user who can consider the requirements imposed by his own child sample. 



Matches 



P-fl : Blum-Fie Ids tee 1 Developmental Charts (T) used in conjunction with 

Gesell Developmental Schedules (T) for selected parts of each; Accident 
Proneness (ObP) ; Motor Behavior (ObF); Motor Behaviors (TP); Rail-Walking 
Test (T) ; Gross Motor Tasks (T) ; Denver Developmental Screening Test (T) 
for parts; Vineland Social Maturity Scale (T) for parts* 



P-1 (No objective)* See P-4. 

P-2 (No objective); A-B-C Vision Test for Ocular Dominance (T) ; Left- 
Right Discrimination Test (T) « 

P-3-1 : Anthrepome tries and Somatotype (TP); Wetzel Grid Charts (T) ; 

Width-Weight (T) ; Merri 11-Palmer Logarithmic Developmental Graph (T), 

P-3-2 ; Nutritional Status and Diet (TP), 



F»3-3 ' Dental (TP); Medical (TP); Neurological Evaluation (TP); Infant 
and Maternal History (T) * 
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P- 4- 1 : Goodenough-Harris Drawing Test (T) ; Drawings (TP); Children's 

Paintings (TP); Draw- a -‘Person ( r ) ; Riley Preschool Developmental Screening 
Inventory (T) for subtest; First Grade Screening Test (T) for subtest; 
Measuring Scale for Freehand Drawing (T) ; Slosson Drawing Coordination 
Test (T). 



F-4-2 ; Graham , Berman, and Ernhart, 1960; Copy Forms Test (T) ; Bender 
Gestalt Test for Young Children (T) ; Visual Motor Gestalt Test (T) ; 

First Grade Screening Test (T) for subtest; Riley Preschool Developmental 
Screening Inventory (T) for subtest; Lurcat Test of Graphical Abilities (T) # 



P-4-3 : Optic Evaluation (TP); Psychomotor (TP); AO H-R-R Pseudo Iso- 

chromatic Plates (T); AO School Vision Screening Test (T) ; Arthur Adaptation 
of Lei ter (T) ; Auditory Discrimination Test: Wepman (T) ; Children's 

Auditory Discrimination Inventory (!) ; Cohn Visual Acuity Chart (T); 

Denver Developmental Screening Test (T) ; Bvorine Pseudo-Isochromatic 
Plates (T) ; Eames Eye Test (T) ; Freeman Acuity Tester (T) ; Frostig Develop- 
mental Test of Visual Perception (!) sub tests; Gesell Developmental 
Schedules (!) ; Halstead Battery of Neuropsychological Tests (T) ; Illuminant- 
Stable Color Vision Test (T); Katz Auditory Screening Test (!) ; Lineoln- 
Oseretsky Motor Development Scale (T) ; Mark-Car Accuracy Test (T) ; 
Massachusetts Vision Test (T) ; Merrill-palmer Seale of Mental Tests (T) ; 
Moore Eye-Hand Coordination Test (T); Motor Steadiness Battery for Children 
(T) ; Oaeretsky Tests of Motor Proficiency (T) ; Pre-Tests of Vision, 

Hearing, and Motor Coordination (T); Ryckman-Berei ter-Powell Auditory 
Closure Test (T) ; Spiral After Effect Test (T) ; Stycar Hearing Tests (T); 
Temp 1 in Speech Sound Discrimination Test (!) ; Three-Dimensional Auditory 
Discrimination Test (T) ; Valet t Developmental Survey of Basic Learning 
Abilities (T) subtests; Go ldman-Fr is toe-Woodcock Test of Auditory Dis- 
crimination (T) , 



P-5 (No objective): Play (Gbp) ; Gf. P-0. 



P-6 (No objective)* Vineland Social Maturity Scale (T); Preschool At- 
tainment Research (T) ; Freud, 1965--3J subparts of Gesell Developmental 
Schedules (T) and Blum-F laid steel Developmental Charts (T) ; subpart of 
Cain-Lev ine Social Competency Scale (T) . 



P-7-1 : Speech (TP); Arizona Articulation Proficiency Scale (T); Fisher- 

Cogemann Test of Articulation Competency (T); Goldman -Fris toe Test of 
Articulation (T) ; Hejna Developmental Articulation Test (T) ; Integrated 
Articulation Test (T) ; Irwin Articulation Test (!); Laradon Articulation 
Scale (T); Preschool Language Scale (T) subtest; Speech Articulation 
Test for Young Children (T) * 



P-7-2 : Bricker , 1967; Echoic Response Inventory for Children (T) ; Massad 

Mimicry Test (T) ; Parallel Sentence Production Test (T) . 
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Pj8 (No objective)^ No good measures located,* 

C-Q-Ar itlmio 1 1 c (No objective): (Use in connection with 02- 2) American 

School Achievement Tests: Arithmetic Readiness (T) ; Arithmetic Concepts 

Inventory for Kindergarten (T) ; Comprehensive Mathematics Inventory (T) ; 
Head Start Arithmetic Test (T) ; Preschool Kindergarten Modern Mathematics 
Test (T) * 



G-Q*Reading : American School Reading Readiness Test; Binion-Beek Reading 

Readiness Test (T) ; C lyme r-B ar re 1 1 Prereading Battery (T) ; Gates Reading 
Readiness Test (T); Gates-MacGinitie Reading Readiness Skills Test (T) ; 
Harrison -Stroud Reading Readiness Profiles (T) ; Keystone Ready to Rear 
Tests (T) ; Lee-Clark Reading Readiness Test (T) ; Lippincott Reading Read- 
iness Test (T) ; MeHugh-McParland Reading Readiness Test (T) ; Murphy- 
Burrell Reading Readiness Analysis (T) ; Prereading Inventory of Skills 
Basic to Beginning Reading (T) ; Prereading Test (T); Reading Aptitude 
Tests (T); Reading Readiness (T) ; Spaehe Binocular Reading Test (X); 
Steinbach Test of Reading Readiness (T); Watson Reading Readiness Test 
(T); Diagnostic Reading Tests (T) . 



G -0-Re ad i ness a General (No objective ): Individual Diagnostic Tests -- 

Minnesots Preschool Scale (T) ; Prekindergarten Goal Card (T) ; Valetfc 
Developmental Survey o£ Basic Learning Abilities (T) • Re ad iness for 
Paper and Pencil Tes t s - -yi s ion » Hearing gnd Motor Coordination (T). 

Parent Administered Readiness - -Early Detection Inventory (T )i Parent 
Readiness Evaluation of Preschoolers (T) ; School Readiness Survey (T) * 
General and Group Tes t s- -Assessment Program of Early Learning Levels (T) ; 
Evaluation Seals for Four* and Five-Year-Old Children (T) ; Evanston Early 
Indentif ication Scale (T); First Grade Screening Test (T); Kindergarten 
Evaluation of Learning Potential (T) ; Kindergarten Tests (T) and Pre- 
dictive Index Tests (T) ; Maturity Level for School Entrance and Reading 
Readiness (T) ; Metropolitan Readiness Test (T) ; Nebraska Test of Learning 
Aptitude (T) ; Peabody Individual Achievement Test (T) 5 Preschool Attain- 
ment Record (T) ; Preschool Inventory: Cooperative (T) ; School Readiness 

Checklist (T) ; School Readiness: Behavior Tests Used at the Gesell Insti- 
tute (T) ; Sprigle School Readiness Screening Test (T) ; Stanford Early 
School Achievement Test (T) ; Vane Kindergarten Test (T) ; Wide Range 
Achievement Test (T) » 



G-l : Attending Behavior (ObP) ; Test of Auditory Discrimination (T) , 

differential between silent and masked portions should provide index of 
listening attention; CASES (T) ; Cincinnati Autonomy Test Battery (T) 
subparts' Attention Span Test (T); Intensity of Task Involvement Scale 
(T); Maze-Trail Test (T) , 



C-2-1 : Conceptual Behavior (TP); Classification Skills (TP); Concept 

Test for Children (T) ; Generic Identity Scale (T) ; Block Sort Test (T) ; 
Inductive Concept Identification Test (T)f Test of Concept Utilization 
(T) ; Toy Sorting Task (T) ; See also G-9-2 a 
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O 2 ~ 2 : Conceptual Behavior (TP); See C-O-Ari time t i c for related tests; 

See also C-9-2, 



C-2-3 1 Conceptual Behavior (TP) ; Time (TP) ; Time Concept Test (T) ; See 
also C-9- 2 . 



C-2-4 : Conceptual Behavior (TP) ; See also C-9-2 « 



C-2-5 : Conceptual Behavior (TP); See also C-9-2 . 



C-2-6 : Basic Concept Inventory (T) ; Boehm Test of Basic Concepts (T) ; 

Instructional Concepts Inventory (T) ; Peabody Individual Achievement 
Test (T) ; Stanford Early School Achievement Test (T) ; Tests of Basic 
Experience (T) ; Tests of General Ability (T) subtest; Wide Range Achieve* 
mint Test (T) » 



C-3* See A- 35 . 



C-4 (No objective) ; Individual Tests - -Ar thur Point Scale of Performance 
Tests (T) ; Columbia Mental Maturity Test (T) ; Merr 1 11-Palmer Scale of 
Mental Tests (T) ; Minnesota Preschool Scale (T) ; Pictorial Test of Intel- 
ligence (T) ; Slosson Intelligence Test (T) ; SLanford-B inet (T) ; Wcchsler 
Intelligence Scale for Children (T) ; Weehsler Preschool and Primary Seale 
of Intelligence (T). Group Intelligence and Aptitude * -American School 
Intelligence Test (T) ; California Short-form Test of Mental Maturity (T) ; 
Cattell (T) ; Davis-Eells Games (T) ; Detroit Kindergarten Test (T); Detroit 
Test of Learning Aptitude (T) ; IPAT Culture Fair Intelligence Test (T) ; 
Kuhlmann-Anderson (T) ; Lorge-Thorndike Intelligence Test (T) ; Mental 
Abilities (T) ; Otis Group Intelligence Scale (T) ; Otis-Lennon Mental Ability 
Test (T) ; Pintner -Cunningham Primary Test (T) ; Pre-Primary Mental Ability 
(T) ; Scholastic Mental Ability Tests (T) ; Screening Test of Academic 
Readiness (T) ; Short Test of Educational Ability (T) ; SRA Teats of General 
Ability (T) ; Tests of General Ability? Inter-American (T) * Multi-factor *- 
SRA Primary Mental Abilities (T) ; See also G-9-I for multi-factor. 



C-5-1 ? Language (TP); Story Retelling Technique (TP); Incomplete Story 
Technique (TP) ; Tell as Story Technique (TP) ; Test of Verbal Maturity 
(T) ; Pluralization Test (T) ; Early Childhood Language Tests (T) * 



C-5-2 ; Language (TP) • 



C-5-3 ; Vocabulary (TP); Expressive Vocabulary Inventory (T); Full Range 
Picture Vocabulary Test (T); Holbom Vocabulary Test for Young Children 
(T) ; Peabody Picture Vocabulary Test (T) ; Quick Test (T) ; Van Alstyne 
Picture Vocabulary Test (T)* 
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G- 5 "General : Language (TP); Assessment of Children's Language Compre- 

hension (T); Houston Test for Language Development (T) ; PLA (T) ; Preschool 
Language Scale (T) ; San Francisco Inventory of Communication Effectiveness 
(T) ; Tests of Basic Language Competencies (T) ; Vance Language Skills 
Test (T); Verbal Language Development Scale (T) ; ITPA — See C-6. 



C-6 : Illinois Test of Psycholinguistic Abilities (T) ; Kent-Rosanof f 

Free Association Test (T) ; Non-Verbal Representation Tasks (T) ; Word 
Association (TP); See also C-8-2 and P-4-3 for potentially related material 



C-7-1 : Memory (TP); "Digit Span" subtest from Stanford -Binet (T) or 

Wechsler Intelligence Scale for Children (T); subtest of several tests 
in C-O-Re -^ ines.a , General . 



C-7-2 : Memory (TP); See picture vocabulary tests in C-5-3 which are 

usable here; "Incidental and Intentional Learning" from Cincinnati Auto- 
nomy Test Battery (T) . 



0-8-1 : Discrimination Learning (TP); Perceptual Processes (TP); Ayres 

Space Test (T) ; Children's Embedded Figures Test (T) ; Coloured Progressive 
Matrices (T) ; Figure-Ground Test (T) , Figure Recognition Test (T) ; Frost ig 
Developmental Test of Visual Perception (T); Haptic Perception Test (T); 
O'Connor Wiggly Block (T) ; Rod and Frame Test (T) ; TV Test Battery (T) ; 
Valett Developmental Survey of Basic Learning Abilities (T) ; Visual Dis- 
crimination Inventory (T) « 



C-8-2 : Perceptual processes (TP); Psychorootor (TP); Assessment of Per- 

ceptual Development (T) ; Auditory Visual Pattern Test (T) ; Bender Visual- 
Motor Gestalt Test (T) ; Frostig Developmental Test of Visual Perception 
(T); Haptic-Visual Matching Test (T) ; Kindergarten Tests (T) ; Learning 
Methods Test (T); Primary Visual Motor Test (T); Reitan-Indiana Neuro- 
psychological Battery (T) ; Screening Test for the Assignment of Remedial 
Treatments (T); TV Test Battery <T) ; Valett Developmental Survey of Basic 
Learning Abilities (T), 



C-8-Styles : Children's Embedded Figures Test (T) ; Conceptual Styles 

Sorting Task (T); Design Recognition Test (T) ; "Early Childhood Embedded 
Figures Test" in Cincinnati Autonomy Test Battery (T) ; Haptic-Visual 
Matching Test (T) ; Multiple Categorization Test (T) ; Object-Picture 
Categorization Test (T); Rod arid Frame Test (T)« 



C-9-1 ; Structure of Intellect (TP); TV Testing (TP); Cognitive Aspects 
of Learning (TP); Cognition, General (ObP); Block-Design Test (T); Cognitive 
Abilities Test (l L’); Coloured Progressive Matrices (T); Foster Mazes (T); 
Johns Hopkins Perceptual Test (T) ; Let's Look at Children (T); Porteus 
Maze Tests (T). Some of these are good indicators of g as well as measures 
of differentiable components of intelligence. 
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09-2 : Pi age ti an Concepts (TF) ; Cognition., Piaget (ObP) ; Concept As- 

sessment Kio-Conservation (T) ; Conservation Pictures Test (T); See also 
C-2-1 through 



A*I S A-2 s Aggression (ObP); Ascendance (ObP); Dominance /Submission (ObP). 



A-3» A-4 (No objective): Classroom Climate (TP); See related material 

in A-48 and A-49 >, 



A-5 * Imitation (ObP); See also P-7-2 . 



A-6, A- 11 : Sex-Typing (TP); Sex-Tvping (ObP); Toy Preferences (TP); 

IT Scale for Children (T) ; Structured Doll Play Test (T); Toy Preference 
Test (T) e 



A-7, A-9. A-14. A-43 : Controls (TP); Resistance to Temptation (TP); 

Following Instructions (ObP); Guilt Assessments (TP); Delayed Recall 
of Designs (T) ; Design Recognition Test (T) ; Draw a Line Test (T) ; Form 
Board (T) ; Haptic-VIsual Hatching Test (T) ; Motoric Inhibitions Test (T) ; 
Motor Steadiness Battery for Children (T) to detect impulsivity; ,f Re- 
f iec tivity-impulsivity 11 from Cincinnati Autonomy Test Battery (T) ; Walk 
a Line Slowly Test (T) . Carefully selected projective techniques may be 
appropriate here"-* see Projection, general (TP). 

A-8 a A~47 : Dependency s Attachment (ObP). 



A-9: Sae A-7. 



A-10 : Adult Role (TP); Q-Sort (TP); Autonomy (ObP); Detachment (ObP); 

Leadership (ObP); Maturity (ObP); Behavior Inventory: Head Start (T); 

Cincinnati Autonomy Test Battery (T) ; Maxfield-Bueholg Scale of Social 
turity (T). 



Aril s See A-6. 

A-12. A«13 : Cooperation Device (TP); Empathy (TP) J Social Interaction 

(TP); Extraversion/Introversion (ObP) ; Prosocial Behaviors (ObP). 

A* 14 ; See A-7 . 
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A-15 (No objective)! Cain-Levine Social Competency Scale (T) ; Calif- 
ornia Preschool Social Competency Scale (T) ; Inventory of Socialization 
of Bilingual Children (T); Kohn Social Competence Scale; Preschool At- 
tainment Record (T) ; Vineland Social Maturity Scale (T) • 



A-16 ; Color Meaning Awareness Test (T) ; Racial Awareness Test* Estvan, 
1959^-S,; Estvan, 1965; Story Retelling Technique (TP) 0 



A-17 : See A-36« 



A-18 (No objective)^ Primary Academic Sentiment Scale (T); PROSE (TP); 
Weikart Educational Attitude Test (T) # 



A-19 : Egocentrism and Private Speech (TP); Social Expectations Scale (TP); 

Cruise, 1966, 

A- 20 (No objective): A Book About Me (T) ; Perceptions of Adult Role (T) ; 

Social Ability (TP). 



A-21 ; Person Preference (Obp) : Socicmetric Picture Display Device (TP); 
Picture Socicmetric Technique (T) ; Play Situation Picture-Board Socio- 
metric (T) ; Reputation Among Peers (T) * 



A~22, A" 23 : Emotional Cornmunic a t ion (ObP) ; Emotion Recognition Task (T) * 



A- 24 to A-26, A-29 to A-32^ A-41 ; Dispenser Device (TP); Discrimination 
Learning (TP); Reinforcement Delay (TP); Delay of Gratification Task (T) ; 
Mi ache! Technique (T) ; Social Reinforcement (TP); Teacher Behavior (TP); 
Aspiration, Achievement Orientation (ObP) ; Gumpgookies (T) ; Children's 
Locus of Control-External (T) * 



A-27 ? part of A- 31 : Stimulus Variation (TP); Curiosity and Exploratory 

Behavior (ObP) ; Children's Reactive Curiosity Scale (T); Curiosity Box (T) * 



A- 28 : Thematic and Stylistic Preferences (TP); Group Test of Color/Form 

Preferential Behavior (T) ; S troop -Like Co lor /Form Task (T) ; See also 
A-18 i A-21 , A-27 . 



A”2 9 to A-3 2 * See A-24 to A-26 # 

A*33 to A- 34, A-39 to A-40 , A-42 a A-45 : ©notional Reactions (TP); Emotion- 

ality (ObP); sub tests of Bristol Social-Adjustment Guides (T) ; Rating Form 
for Fear (T); Sarason-Type Anxiety Rating Scale (T) ; Temperament (ObP) ; 
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Adaptive Behavior to Demands (ObP) ; Inventory o£ Factors Affecting Test 
Performance (T) • 



A-35, C-3; Creativity (ObP) ; Divergent Thinking (TP); Structured Play 
(TP) 5 Children s Individual Test of Creativity (T); Cincinnati Autonomy 
Test Battery (T) , parts; Gross Geometric Forms (T) ; Minnesota Tests of 
Creative Thinking (T) ; Mother Goose Problems Test (T) ; Originality Test 
(T); Torrance Tests of Creative Thinking (T) ; Ward Creativity Tests (T) , 



A-36, A-17 ; Self Concept (TP); Self Concept (ObP); Brown IDS Self Concept 
Referents Test (T) ; Experimental Photographic Self-Concept Test (T) ; 
Illinois Test of Self-Derogation (T) ; Inferred Self-Concept Judgment Scale 
(T); Measurement of Self-Concept in Kindergarten Children (T) ; Preschool 
Self-Concept Pictures Test (T); Self Concept Rating Seale (T) ; Self Concept 
Silhouettes (T) ; Self Social Constructs Test (T) ; Thomas Self-Concept 
Values Test (T) . 



A~37 ; Cattell and Peterson, 1959; Damarin and Cattell, 1968; Schachter, 
Cooper, and Gordet, 1968; Personality, Global (ObP); Ego Development 
Stages (TP); California Test of Personality (T) ; Personality Evaluation 
Form (T); when available. Preschool Personality Questionnaire (T) ; Merrill- 
Palmer Personality Rating Scale (T) , Carefully selected projectives may 
be appropriate here — see Projection, general (TP) » 



A- 38 ; Psychiatric Evaluation (TP); Adjustment (ObP); Desirable/Undesirable 
Behaviors (ObP); Bristol Social-Adjustment Guides (T) ; Detroit Adjustment 
Inventory (T); Devereux Elementary School Problem Behavior Rating (T); 

Ear ly-Adjustment-To -School Scale (T) ; Haggerty-Olson-Wickman Behavior 
Rating Schedules (T) ; Kohn Problem Checklist (T) ; Nursery School Adjustment 
Scale (T); Personal-Social Adjustment Rating Scales (T); Preschool Teachers 
Rating Scale (T); Process for In-School Screening (T) ; Symptom Checklist (T) 
Carefully selected projectives may fit here — see Projection, general (TP), 
but overt behavior has the highest known validity. This is especially 
true of overt interpersonal behavior. 



A-39, A-40 ; See A-33 . 
A-41 ; See A- 24 . 

A-42 ; See A-33 . 

A-43; See A-7. 
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A-44 ; Children's Stories (TP); Dranatic Play (TP); Doll Play (TP); Play 
(TP); Play Therapy (TP); Projection, general (TP); Projective Play (TP); 
Thematic and Stylistic Preferences (TP). 



A-45 ; See A-33. 



A-46 (No objective). 



A-47 ; See A-8. 



A-48 to A-49 (No objective): Children Rearing Practices (TP); Environmental 

and Ecological Analysis (TP); Family Characteristics (TP); Parental 
Teaching and Interacting (TP); Social Stratification (TP); Social Status 
Scale (T) ; Social Stratification Guidelines (T) ; Attitudes Toward Parental 
Control of Children (T) ; Education Attitude Survey (T); Fami ly Adjustment 
Test (T) ; Family Relations Test (T) ; Maryland Parent Attitude Survey (T) ; 
Modified PARI for Mothers and Fathers (T) ; Mother-Child Relationship 
Evaluation (T) ; 0E0 Parent Activity Form (T); Parent Attitude Inquiry (T) ; 
Parent Attitude Research Instrument (T) ; Parental Role Questionnaire (T) ; 
Parent's Expectation Inventory (T) ; Permissiveness Scales (T); Racial 
Attitudes of Parents (T)| Sex-Rcle Attitude Test, Parents (T); Teacher 
Irritability Scale (T) | "This I Believe" Test (T) ; Winterbottom Scale (T). 
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RECOMMENDATIONS FOR FURTHER DEVELOPMENT OF MEASURES 
FOR DETERMINING TERMINAL DEVELOPMENTAL CHARACTERISTICS 

In the foregoing section, some deliberate heaping up of assessment 
procedures has been accomplished in order to anticipate and support the 
following statement: no creation of new measures of terminal develop- 

mental characteristics at governmental expense is warranted except in a 
few areas that can be clearly pointed up by reference to the preceding 
section* This must be quickly qualified, however, with the statement: 
but much systematic effort is justified in the further validation and norm 
Ing of existing measures. The prase chaotic state of the measurement 
side of early childhood evaluation could be reduced to a new orderliness 
in the service of programs and the advancement of knowledge, if sufficient 
national investment were made in a plan like that outlined below* This 
section is deliberately focused upon product evaluation measures, in 
keeping with the contractual agreement . Similar forays could also be 
made into objectives formulation and the process of objectives implemen- 
tation, but time denies extensive attention to them hare* 

First, however, some remarks will be directed against commonly pre- 
vailing test development assumptions and practices which seen to have 
contributed directly to the present state of affairs. For several 

I 

generations the pattern of norming for tests, which were destined for 
broad public acceptance, has been to administer them to a stratified 
sample, constituted in representative proportions relative to some census 
figures or estimates* Short cut approximations have also been attempted , 
but without challenge to the underlying assumptions of representative 
norming. This practice presumably guarantees the quality of the test and 



its appropriateness for administration to the entire universe represented 
by that sample. Within this framework, separate reporting of central 
tendency and dispersion, reliability and validity for subgroups of the 
no ruling sample has been almost unheard of. But it is difficult to imagine 
under what conditions any sizeable group of investigators or practitioners 
could or should be interested in the statistical artifacts produced by 
this approach to norming tests. Who is interested in the datum that 
IQ 1QQ is the mean of the population, when a sample of it has been con- 
stituted in this census-proportional manner? Some governmental agencies 
appear to desire this kind of diffuse, overall effectiveness answer, but 
to give it is to obscure more than one uncovers. Or, more germane ly, 
what is the meaning of a deviation from this arbitrary population mean 
for a given child- -since his relevant demographic comparison group is 
nowhere reported upon in the statistics of the iest? It is strange indeed 
that supposed measures of individual differences have been developed in 
such disregard for the foundations of differential psychology. Children 
iiffer because they come from different demographic backgrounds. Their 
progress is best gauged relative to the conditions that obtain in their 
>wn cases. Thus, particularly when one moves into the area of evaluating 
the attainment of educational objectives, the needed yardstick of progress 
Ls not to be found in ever so many standardized tests however good their 
Item validity. Their failure arises from persistent misconceptions of 
-he purposes to which sampling theory can be turned and the legitimate 
Limits of population description. 

Rather than to rain further blows upon this unwieldly beast--the 
:est normed on a sample representative of the total population--! t is well 
:o look at some byproducts of this approach to measurement development. 
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Numerous Investigators, who have despaired of finding relevant measures 
of certain constructs for the particular demographic subgroups that they 
were studying, have spawned an ever widening array of poorly validated 
instruments about which only the spottiest of information is available. 

And, often to the credit of the investigators' daring, these few- time- 
used tests have indeed proved more suitable to the samples studied than 
have their revered, standardized competitc . The argument here is, 
nevertheless, not against normative tests; it is against those conditions 
which force evaluators and researchers into the position of having to 
develop their own tests to obtain subpopulation validity. 

An obvious but unused alternative would be to norm a to-be-standardized 
test on all potefstial populations rather than on the artifactual overall 
population. How refreshing it would seem to turn at will in the manual 
of any cognitive or psychomotor or affective test to the section dealing 
with that particular population of children with which one is most nearly 
concerned. That subsets of an aggregate may behave quite differently 
under varying conditions is taken for granted in the physical sciences 
to the extent that separate tables are prepared for different solvents 
and different performance curves are charted for differing atmospheric 
conditions. Yet with something as complex as individual huusns, the un- 
tenable tendency persists of lumping all together. 

Take as a starting point for the required information breakdown 
some expanded form of those demographic subgroupings which have been 
used throughout this project, i.e., age, ethnicity, and socioeconomic 
status. To these one would surely wish to add sex, possibly an inner 
eity-rurai-suburban split, and such others as some expert panel of demo- 
graphers, differential psychologists and sociologists, census analysts. 




ERIC 



17 



and experts in comparative education might agree upon as minimal. At 
this point one could identify those subsets of the total population to be 
represented in a norming procgdure—except that they would not again be 
sampled proportionately but in such nmnbers as to provide stable estimates 
of each subpopulation’s parameters for some given assessment device. 
Further ? these data should be gathered on untreated or typically treated 
samples of the subpopulations. If reactivity to being treated is con- 
sidered a fundamental problem in assessment- -and it should be-- then one 
would better arrange for the administration of a standardized "reactive 
treatment" to his samples throughout the period of their participation 
in norming. Results would be reported in the manual of each instrument 
according to some minimal subpopulations list, if the instrument were 
to be considered of acceptable comprehensiveness for use in educational 
outcomes assessment. Undoubtedly this would be a windfall to all in- 
vestigators of child development as well. If the physiea 1 sciences 
recognize in excess of 100 elements, each having its own legitimate ex- 
istence , should not the human sciences begin to consider alternatives to 
their single element approach to describing and measuring humans? 

This kind of assessment norming should be conducted for at least 
one procedure or device in each of the areas in which educational objectives 
are presently justified for five-year-olds in Report III* Part A. Pre- 
liminary comparative study of multiple measures will often be required 
prior to the norming stage. Further* it should not be construed that a 
single measure will suffice for all demographic subgroupings. In some 
cases different instruments may be retained because they measure the same 
characteristic better in differing demographic subgroups. Informed 
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measurement has often used different devices for different applications 
to produce equivalent estimates. 

If all of this were accomplished* the result would yet be somewhat 
unsatisfactory without attention to across -time trends (i„e„* longitudinal 
samples) within suhpopitlations for a given measure* The frequency of 
these aeross-txme samplings should be spaced so as to correspond* for 
educational purposes* to those curricular change intervals at which it 
will likely be necessary to assess the effects of short-term intervene >ns a 
Four or six week intervale might seem desirable to fit whatever con- 
tingencies arise in operating px*ograms. Longer term interventions may 
require for their assessment only the accumulation or trend of these 
shorter- interval periods. That is* the differential between two age 
points would serve as an index for longer-term educational outcomes® 

The purpose of establishing tables of across -time trends for subpopulations 
is to free the program evaluator of some of the usual* costly* and perhaps 
insurmountable burdens of his role . 

How this is accomplished is apparent when one considers the impli- 
cations of across-time* normative* subpopulation sampling in the standard- 
ization of a test. Having such available*a program evaluator could now 
determine the significance of a treatment without recourse to the often 
unavailable control group. He would in effect be making comparisons 
of his treated group to normative* subpopulation growth trends to which 
undifferentiated reactive treatment effects had been experimentally 
added at the time of standardization* That educational treatment would 
be considered successful which resulted in a significant upward departure 
from the pertinent growth trend* over the interval of the treatment. 



Groups entering a treatment at a level above or below their subpopulation 
growth curve would be analyzed for significant upward departure *vam the 
trend , with reference to their own starting level. Original experimental 
control over reactive effects would rule them out as an alternate hypo* 
thesis to the program* s contention that it was affecting children 1 s 
developnent * 

At this point the reader is perhaps impressed both with the ad- 
vantages over present practices and with the potential high cost of 
establishing such tes t norms * Despite possible misgivings on the latter 
count 5 a cost analysis study would undoubtedly show a net cost benefit 
to public education in the long run from (1) the reduction of continuing 
fixed costs of control group selection and testing, (2) the improved 
quality of decision making made possible by more reliable evaluation, and 
(3) the diminished need to make agonizing decisions about who shall and 
shall not (i e e* 3 as treatment and control groups) receive some promising 
educational commodity! The break-even point, from such an investment 
in better and more relevant norms, would surely come soon enough to 
provide the hoped for cost benef i ts—even in the event that it should 
prove necessary 7 to renorm tests in this way about every five years* 

Clearly what is recotiTnended is a vast infusion of governmental support 
into a chaotic but basically sound test development market. The infusion 
should, however, not be undifferentiated but precisely targeted for cri- 
terion accomplishments* General calls for new measures in this or that 
domain for five-year-olds is absolutely unwarranted, according to the 
aggregated evidence of the 3 ’Matches" section of this report* 

It will, nevertheless , be insufficient to call for refinements and 
no tming of existing tests without a coordinated empirical effort to establish 
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the subpopulation construct validity of those developmental measures 
which are selected for field testings Such a federal effort could pro- 
bably be coordinated to supply the missing across -domain correlational 
information which was pointed out in Reports I and II as a major know- 
ledge gap. For the foregoing reasons, this norming must be carried out 
by test construction experts working eoilaboratively with child develop- 
ment experts and others* The level of technology in both of these dis- 



ciplines appears high enough to warrant the confidence implied by the 
large scale effort recommended here. These disciplines unfortunately 
lack a history of closely collaborative effort. To offset this, it is 



recommended that any initial contracts be awarded to groups demons t rating 



their capacity to work eoilaboratively and productively across these 
disciplinary ines. Such initial validity studies should be conducted 
in close conjunction with ongoing early childhood programs which involve 
children from the diverse demographic backgrounds with which U.S,0*E. 
is ultimately concerned. 



This plea for a symbiotic linkage between measurement research and 



ongoing programs echoes our remarks in Report I to this effect, A greater 
contemporary contribution by the child deveiopment^measureanent team to 
the program 1 s daily formative evaluation would complete such symbiotic 
ties by making this evaluative effort (1) contribute directly to in- 
struction and by (2) informing the test developers more precisely of the 
characteristics of the children for whom they are developing sunmative 
devices. Continuing the present extrinsic and potentially exploitive 
relation of research to ongoing programs would, on the other hand, surely 



guarantee perpetuation of data gathering problems that is presently 
expensive and destructive of our best efforts to understand children 
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better. See in justification of this recommendation a sensitive ex- 
position of ET3 f s efforts to work produo Lively within the current, less*” 
than-workable framework of relations between research and programs * 
(Educational Testing Service, 1969--SJ) • 

Even given all of the foregoing improvements $ local adaptations of 



evaluation will still be warranted* Such adaptations ought only to be 
made according to recommended guidelines* Educational Testing Service 
currently offers a package of materials for preparing teachers and other 
school personnel to construct their own tests,. They along with other 
major test publishers, some educational laboratories, and some private 
producers of instructional materials now offer extensive consultation 



services in support of local test modification and production efforts* 

What is needed is a comprehensive set of guidelines establishing the limits 
and allowable practices of local school organizations in their adaptation 
of criterion tests that have been adopted by the U* S* Office of Education 
as parts of their cost accountability- -program effectiveness system. The 
concept of norming components tests rather that omnibus tests (i*e* , 
favoring those of greater factorial unity) would make much easier the 



making of decisions of whan to allow the broadening or narrowing of an 



evaluation device in the Interest of better local fit. In 



with these rec ommenda t ions : local districts may need even more to receive 
consultation and specific guidance in their preparation of objectives 
and their evaluation of implementation, because product evaluation of 
necessity assumes but leaves untested the adequacy of these antecedent 
processes. And again a more integral connection between programs and 
measurement research efforts could provide new answers to these needs. 
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If the development of new tests is warranted, it is in those areas 

where programs make promises to affect the child in ways which they claim 
are not adequately assessable by present methods. While these claims 
are not necessarily evasive (although one can hope that the preceding 
section on f "Matches 11 will discourage some uninformed claims about the 
elusiveness of particular outcomes), they do deserve careful scrutiny in 
an era of increased cost sensibility. For this cause, it Is recnrnmended 
that a formal screening procedure be established in U.S*0,E, whereby 
those making such claims regarding their programs may submit them to 
unusually qualified scrutiny, without prejudice, as a part of the process 
whereby proposals are reviewed. Those responsible for such a screening 
procedure should be prepared tu (1) recommend suitable measures subject 
to the contract bidder 1 s further examination and possible acceptance 
or (2) recommend concurrent studies of new measures to be conducted during 
the course of the program. 

Objectives areas in which instrumentation appears to be clearly 
inadequate, to the extent of making new instruments welcome additions 
are: P-3-2 for parental completion or for teacher interview of parent; 

0-1; A-22 and A-23; and A-28. Further it strumentation in P-1 and P-5 
semis desirable and might lead to enough additional knowledge to warrant 
formulating objectives. In P-8 and A-46 there is an almost total silence 
in the literature, suggesting that procedures for measuring these child 
characteristics would be first steps toward understanding them. The 
exclusion of other areas does not imply uniformly satisfactory measure- 
ment but only that existing approaches are worthy of further validation 
study. No intent exists to discourage new maasuramant work in these 
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other areas a In fact, it is to be encouraged specif IcaiXy under the 
conditions mentioned in the following paragraph* 

Another area in which new measures might be justified would be in 
the reduction of the Technical Procedures and Observational Procedures 
of Report III, Part B to forms which could more readily be used by in- 
school personnel* Soixe admirable examples of progress in just this kind 
of translation process are evident in recent test developments related 
to language, self "Concept ^ internal controls, information processing 
styles, conceptual behavior, and global aspects of personality among 
five -year-olds • 

If all of the above^recommendad s measurement-related functions are 
not to result in a proliferation of uncoordinated subagency efforts within 
U,S*0*E,, then the creation of an office responsible for and empowered 
to coordinate such efforts would seem a priority-- that is, U.5,0*E, 
needs a measurement and evaluation team capable of coordinating these 
functions and contracting for new work in support of detected program 
needs for measurement development* 

Finally, the process of assessment delivery itself deserves systematic 
attention* Considerable evidence has been adduced in a growing literature 
favoring the conclusion that the conditions of tasting can be so managed 
as to enhance or depress differentially the performance of various sub- 
groups of children* Several representative selections from that liter- 
ature are listed in Appendix D of this report. They are easily identi- 
fied by the manifest content of their titles, so are not listed separately 
here, A report to evaluators and practitioners, based on this literature, 
should be prepared drawing particular attention to the known effects of 
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varying testing conditions upon particular d <21110 graph i c subgroups (i,e, , 
a critical and synthetic review of this literature)* Such a report 
might do much to offset some continuing abuses of testing with children 
from minority groups and further insure more believable evaluations, 

The preparation of such a report in language and style compatible with 
field distribution should be viewed as a priority recommendation. Too 
much is known now to as sume that all children can be subjected to the 
same assessment procedures with equivalent results* The patent frivolity 
of such a suggestion as regards five-year-olds makes ji propos the inclusion 
of this recommenda t ion in this final report* Further, the possibility of 
using the testing situation to teach children responsiveness to cognitive 
demands and to impart test-wiseness ought not to be overlooked. Some 
compensatory programs seam not to have been highly successful in these 
very respects. 

The recommendations as given above have pointed out a new direction 
for U.S.G.E, pertaining to the norming of evaluation instruments and to 
the possible contribution that such norming could make if careful at- 
tention were directed to d^oographie subgroup sampling and reporting in 
test manuals. It has further been shown how across-time, normative, 
subpopulation standardization of tests could be conducted without in- 
creasing (and probably by actually reducing) the current national cost 
of evaluation. Except for the few designated areas cited, the need for 
developing new tests has been found to be less urgent than the standard- 
ization and demographic norming of existing tests • These recommendations 
have been made after careful scrutiny of both evaluation instruments and 
developmental characteristics of five-year-old children and* therefore, 
warrant careful consideration. 
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APPENDIX A 



A- 1 



Circle Code 



Abstract Sheet (Abstract # 



1st Author Affiliation or Address_ 
Title 



Publisher or Publication 



Volume-date-pages (or document source)_ 
Research setting^ 



C,6 Negro Age 3=jL, 4=2; Ntisery School-3^; 5®4| Headstart & Kindergarten-5^ 3,4=2 
4 , 5=_7 ; 3 ,4, 5=2; over 5-£ 

NS ' s , , 

Cc7 Anglo Age 3=JL; 4=*2_; Nursery Schoo 1=2; 5=4> Headstart & Kind e. rgar ten=5j 
3,4=2; 4,5=2; 3,4, 5=8 ; over 5=2 



NS's 



C,8 Spanish Surname Age 3«3L; 4=2; Nursery Schoo 1=3^; 5=4; Headstart & 
Kindergarten^; 3,4=2? 4 ,5=2; 3, 4, 5=8* over 5=2 
NS's , , 

C.9 Indian Age 3-JL; 4=2; Nursery School*^; 5=4; Headstart & Kindergarten=2; 
3,4=6; 4,5=7; 3,4,5“jl; over 5=9 

N5's ~ " ' » 

C»10 Mixed 3=1 ; 4=2; Nursery Schoo 1=3.; 5=2i Headstart & Kindergarten^; 

3,4=2; 4,5=2; 3»4,5*8_; over 5=2 

NS' s I, _ „ . - 

0,11 Soeio Economic Level (Guide #2) Hi=4, Med=2, UL“2s LL=1, Mixcd=5 

Al, School Type Nursery School, Kindergarten, Day Care, Headstart, Other 
A2. Rationale Criterion groups, conforms to theoretical position, 
correlates with existing measure. 



0,12,13 Year Standardized If Available^ 



, If Not Availabla=Blank 



C,14 Scored by: Machine=jL, Hand direet=2* Hand converted^, Mixed=4, 

Reusable ^ 

C.15 Scoring Service Available Y#s=l No=2 
C,16 Score Conversion Tables Yes=2 No=2 

C,17 Administration Group Size: Individual^!.; 2-3=2; 4-6=2; 6-10=4; 

10-15=2s ever 15=2; 

C.18 Administered by classroom teacher=JL* Teacher with moderate training=2; 

Specialist=2; Mixed=4; Parents=2 



C«19 Test Type Individual Manipulativss=lj Visuals=2j Systems®3.; Mixed=4; 
Auditory^ 

G.20 Response type oral=lj mark=^; arrange=j3; point“4j mixed^ 

C.21 Timed Yes-I No-2, (Amt.) 



C»34,35„ 36 Measurement (Cognitive, See Guides) 

(U37-38; 39-40; 41-42 Measurement (Affective, See Guides) 

Co43 ,44 ,45 Measurement (Psychomotor, See Guides) 

Continuation cols: cognitive measurement 46, 47, 48 

affective measurement 49-50, 51-52, 53-54 
psychomotor measurement 55, 56, 57 
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Coding Guides 



Guide #1 

(Columns 34 to 57) 

Categories for the Constructs and Behaviors Measured 

Code (Cols, 34 } 35, 36, 46, 47, 48 " Cognitive ) 

0 Ability: specific 

1 Attentional processes (selective, directed, set) 

2 Concepts (categorization, classification, similarity matching, 
labelling, concept attainment) 

3 Creative processes (imagination, intuition, creative play) (See 

also Psychomotor: 1) 

4 Intelligence* general (verbal, nonverbal) 

5 Language (excluding sound production) (See also Psychoraotor: 7 ) 

6 Mediationa! processes (information processing, mediated generalization 
sequencing in idea production, higher associative processes) 

7 Memory (serial, paired associate, general content) 

8 Perceptual (sensory coordination, perception of sequential events, 

cognitive styles, recognition, closure, flicker fusion) (See also 
Psychomotor* 4) 

9 Piagetian tasks and related general cognitive- theory based tasks 
(sensory- tonic field theory, Gesellian, ProblCTi solving) 

Code (Cols* 43, 44, 45, 55, 56, 57- *Pgvctemotor) 

0 Balance, movement, and coordination (Static or Dynamic, with or with- 
out apparatus, gross motor, kinesics) 

1 Construction with manipulables (See also Cognitive; 3_) 

2 Dominance, handedness, laterality, eye dominance 

3 Growth and maturation (skeletal age, somatic proportions) 

Perceptual-motor (fine motor, drawing, copying, hand-eye coordination, 
sensory and motor aspects of perception) (See also Cognitive: 8 ) 
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5 Play 

6 Self-care activities (dressing, toileting, grooming, feeding) 

7 Speech; Motor aspects (See also Cognitive: 5j) 

8 Vitality (endurance, fatigue, recovery) 

9 (Open Category) 

Code (Cols. 37-38, 39-40, 41-42, 49-50, 51-52, 53-54- -Affective) 

Social behaviors 

1 Aggression / Empathy 

2 Dominance / Submission / Resistance / Assertiveness 

3 Situational factors maintaining interpersonal behavior 

4 Familial factors maintaining or teaching interpersonal behavior 

5 Imitation and vicarious imitation 

6 Identification and imitation / Role taking 

7 Resistance to temptation / Dependency / Leniency toward dishonesty 

8 Dependency 

9 Transgression related behaviors (guilt, defenses) 

10 Maturity / Responsibility / Self-directed behaviors / Autonomy / 
Competence 

11 Sex^typing 

12 Pro-social approach / Cooperation / Sharing / Generosity 

13 Introversion-extroversion 

14 Conformity / Acquiescence-negativism 

15 Social Skills / Knowledge of social skills 

Social perceptions and communications 

16 Abstract awareness of ethnicity, SES 

17 Self-awareness with reference to categorical membership or face- 
to-face other ^awareness 

18 Perceptions of school and learning 

19 Abstraction in social reference, social desirability 

20 Social perceptions, other 

21 Social preference / Sociometry 

22 Emotional communication 

23 Awareness of affect 

Motivation 

24 Threats / Punishment 

25 Failure / Success / Frustration / Behavior constraints 

26 Rewards / Reward schedules / Delay of reward 

27 Stimulus variation / Novelty / Complexity / Expectancy violation 

28 History of preferential behavior / Interests / Attitudes / Values 
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29 Types and agents of rewards / Attention holders / Secondary 
reinforears 

30 Peer maintenance of behavior 

31 Higher needs, motives (achievement, affiliation, curiosity) 

32 Teacher maintenance of behavior (e.g # , by attention) 

Intra-psychic f ac tors 

33 Neuroticism versus acting out 

34 Orderliness 

35 Creativity / Playfulness / Tolerance of ambiguity 

36 Self concept (apart from social position) / Body image 

37 General personality (test or rating scale) / Morality 

38 School, social or personal adjustment 

39 Activity level or energy 

40 Characteristic emotional state / Mood / Stress reactions / 
Tension release 

41 Locus of control 

42 Reactivity to stimulation (threshold, intensity) 

43 Inhibitory behaviors / Inner controls / Iin r nisi vity 

44 Fantasy content 

45 Responses to cognitive demands / Task persistence 

46 Humor 

47 Attachment / Detachment 



Social -cultural -familial influences 

48 On program related gains 

49 On general development 



Guide #2 
(Column 11) 

Soc ioeeonomic Level 



Code 

4 Upper - Children of administrators, executives, higher level pro- 
fessionals, entertainers, military commanders, higher level politi- 
cians, independently wealthy. Many samples designated "high** are 
really middle class* Income will not be used, since the index 
varies from time to time, 

3 Middle - Small business owners, foremen, white collar workers, 

larger farm operators, middle and lower level professionals, some 
service workers (more subtle factors separate these into UL and 
Middle), technicians, engineers* These persons are usually salaried* 

2 UL “ Upper lower class - blue collar workers (may have a® high or 
higher income than white collar but are ff working class 11 oriented). 
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small farmer, tradesmen, semi “Skilled, many service workers (e.g., 
laundry, food service), truckers. These persons usually work for 
wages. Some of the ’'technically" disadvantaged fit here, 

LL - Lower lower class - unskilled, unskilled or minimally skilled 
workers, the unemployed, many of the disabled, the tenant fanners, 
^igi^suts, welfare families. Lower lower is perhaps best understood 
as involving a style of life created by the uncertainties and tensions 
of poverty and the traits of instability, restlessness, external 
locus of control, apathy, and a sense of powerlessness. 
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Publisher 


Address 


Adkins, Dorothy C, 


College of Education 
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Allen, Doris Twi tchell 


2447 Clybourn Place 
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Allen, Robert L. 
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INTRODUCTION 

At the time that the U«S*0 o E* issued its request for proposal, and 
the proposal covering this project was prepared, their plans were to use 
directly in their own evaluation efforts those portions of the project 
report appearing hers as Report III, Parts D and E. Subsequently, due to 
internal shifts in plans within U*S.O*E., it seemed advisable to devote 
greater effort to those portions of the project which have been reported 
previously in Reports I and IX, and in III A, B , and C* Parts D and E 
of Report III were not to be deleted but were to be downgraded. Unfortun- 
ately, It has been impossible within the contractual framework to downgrade 
this portion* This fact has perhaps involved us in a purely academic 
exercise* We have chosen,, nevertheless, to speak directly to the issues 
raised in our original proposal* We have hoped in this way to point: up 
the directions to be taken if satisfactory answers are to be made avail** 
able to U.S*O.E* in response tu its future early childhood management and 
planning requirements, based on its experience with Titles I and III programs* 

One need of U*S.O!*E* originally was for the specification of variables 
to be included in any instrumentation to be used in its preschool program 
survey for Titles I and III* It was desired that, together with the 
sampling recommendations of Part E, an instrument operationalizing the 
variables of Part D would constitute an evaluation system for answering 
the following questions; 

a. Which characteristics of preschool pupils are related to 
to later success in primary school? 

b* What are the characteristics of pupils who participate in 
programs and services provided by Federal funds? 
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c* What are the characteristics of the programs and services 
being provided to preschool children by Federal funds? 

d. What is the relationship between pupil participation in 
special preschool programs and services, the home and school 
environment, and pupil development as measured by test^ and 
teacher perceptions of classroom behaviors? 

e. What is the relationship between the needs of the pupil, the 
preschool services and programs available to him, and the 
programs and services in which he participates? 

Question a_ can be spoken to by drawing upon family demographic and 
general environmental variables and upon measured characteristics of the 
child. There is also implied in a the need for at least short-term longi- 
tudinal assessment up into the primary grades. Further, these data are to 
be looked at relationally , These requirements taken together suggest that 
either the individual child or sets of minimally demographlcally-subgrouped 
children within a program would be the basic units for examination. Our 
preference is for the former, but we have judged that U.S,0*E. will for 
various reasons prefer "he latter. Thus, in our recommendations regarding 
variables we have anticipated the latter. This is discussed further in 
Part E* To prepare data for the longitudinal question, they will need to 
be stored across-time counting by demographic subunits within each program. 
This is basically accomplished by frequency recording. Its data ail come 
from the same sources as those for answering question a. 

Question c^ asks for descriptions of programs and services. As we 
have remarked before in these reports, programs cannot be as satisfactorily 
codified at present as can behavioral characteristics. For this reason 
and to guarantee that the inves^ient in a longitudinal study will produce 
a reasonable information return, it has seemed well to describe programs 
in a large variety of ways with ref arena© to qualitative indicators of 
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programs and services delivered, their guiding orientations or philoso- 
phies, and their types of instructional activities. Oversampling of 
program variables is what we recommend. fhis will guarantee, by creating 
a potential for subsequent recombining of variables that the actual pro- 
gram delivered to children can in some objective way be defined at a 
future time. While the recording of these data may appear to be a tedious 
chore or an overkill, it is es&e.ntial in this case. Question d, as a 
longitudinal question, requires no new data, but acres s-ti*ae examination 
of selected interrelationships of the data already specified with re- 
ference to questions and £• Question e^ requires no new data. It can 
be examined for child needs either by direct behavioral measures or in- 
directly through child demographic indicators. These are then to be 
compared with the kinds of preschool program features to which such child- 
ren are being exposed* Logical analysis of goodness of fit of programs 
to needs will be required after the descriptive empirical findings are 
assembled. 

When questions a through <e have been answered in this manner, by the 
data collection and analysis indicated, it will be possible to answer 
certain crucial Office of Education management questions: 

a. At what level should U.S.O.E. fund preschool programs? 

b. What are the unmet needs of preschool pupils and preschool 
age children? 

c. Should U.S.O.E. fund new programs to meet unmet needs or to 
extend existing programs? 

d. What types of programs are working? 

e. On which projects should U.S«0*E. disseminate information? 
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f*. Should new legislation be written in the area of preschool 
programs? 

g. Should legislation or guidelines specify that funds be 

targeted to aid specific minority, ethnic or disadvantaged 
groups? 



A Data Gathering Instrument 



We have judged that the most straightforward method of indicating 
what kinds of data should be gathered was to create a survey instrument 
designed to gather all of the required information. This instrument — 
given the acronym SPEC for SURVEY OF PROGRAM IN EARLY CHILDHOOD—Provides 
comprehensive coverage of the needed data and thus embodies in itself 
our recommendations for what variables shall be studied. The SPEC appears 
hereafter at the close of this section. Before its appearance, however, 
other related matters require discussion. First the general features 
of the SPEC 1 s contents and organization will be examined. This is fol- 
lowed by brief suggestions for its use as a Title I and XXX project report 
document. Next its possible limitations and strengths are discussed. 

These are related, in this discussion, to the ,, RecoTmendations ,, section of 
Part C of this report. Finally, specific recommendations are made for a 
brief, related survey device to be constructed for use at supra-program 
or project management levels, e.g., by responsible state officers. 

Items 1-4 of the SPEC identify the funded program and its reporting 
officer. Items 5-8 sketch out the most general of the program i s or pro- 
ject’s characteristics. Six sections of program quality indicators follow: 
(1) items 9-16C are most general^ on expenditures, facilities, and direct 
instructional support personnel; (2) items 17A-I deal with qualifications 
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of personnel and duration of the child's weekly exposure to program; 

(3) items 18-27 provide the number and kinds of outdoor equipment avail- 
able; (4) items 28-55 describe the number and kinds of indoor equipment 
and supplies, with U.S.O.E. contribution calculated for 3 and 4; (5) 
items 56-64 deal with quality less obviously by examining grouping 
practices; and (6) items 65-77 inspect quality through the ways that 
evaluation is used in the program. 

At this point the questioning shifts to the substance of the program's 
educational focus. Itean» 78-95 use a checklist and an estimation oi: 
percentage of influence to get rapidly into the philosophical -methodological 
sources of the program's inspiration and direction. Because the real 
effects of programs on children are, however, directly mediated through 
what is done in the program, attention is given in items 96-138 to finding 
out which activities command the greatest time priority. Such a list 
can also be examined subsequently to determine what patterns of activities 
emerge as more fundamentally beneficial to children having which kinds 
of behavioral and demographic characteristics. Interrelationships between 
this list and the preceding list should also prove functional for des- 
cribing what activities are commonly used by programs that presumably adhere 
to particular stated orientations. Such knowledge is fundamental to our 
efforts to move beyond the current gross conceptual tools that are avail- 
able for describing what a particular program is, i.e. , to move beyond 
the current atmosphere of name-calling and program identity formation 
by factionalism. Finally, brief attention is turned in items 139-143 
to the process of implementation of program into practice. Aa we have 
indicated before, this is a most neglected area of evaluation., This 



52 



concludes the SPEC’s description of program 0 To our knowledge, this is 
the most comprehensive attempt to date to incorporate within a survey 
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instrument the fundamental dimensions of programs — -yet we do this in a 
most humble spirit in full knowledge of the many items of information 
requested which will ultimately prove to be pure chaffo Hopefully, some 
more Informative item groupings will emerge and endure for incorporation 
into later more sophisticated inquiries on such matters than i 3 our own. 
Auxiliary services provided in conjunction with programs are treated 
separately® 

Items 144-146 sketch out in grossest terms some demographic features 
of the child populations served. Together with other demographic indices 
that can be derived directly from later questions, these form the basis 
for constituting the demographic subgroup sampling and test norming 
system which we advocated in Part C of this report. It al^o provides 
a minimal categorical system for defining what kinds of children are the 
recipients of services. This is expanded and greatly increased in pre- 
cision by the behavioral indicators requested in items 147-152. Our 
recommendation is that at least two behavioral characteristics shall be 
measured, from each of the domains: Cognitive, Affective, and Psychoxnoto 
These shall be chosen from among the subset of selected characteristics 
listed beside items 147-152 of the SPEC such as to be sensitive to both 
the potential strengths and soft areas of the particular programs in which 
they are used. In this way it can be seen whether a particular program 
holds up well across these varied domains of developmental behavior or 
whether its effects are more narrowly circumscribed. It also will guard 
against potentially retarding or deleterious effects upon the child’s 
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total development, which might pass undetected if this more comprehensive 
approach to behavioral evaluation were not undertaken. 

Further child program recipient census information is tabulated in 
items 153-162 with reference to public and non-public program affiliation. 
Items 163-209 explore family and community influences upon the child. 

These data are basic to the description of the. child’s home environment 
and his needs. The instrument concludes with an inquiry in items 210-233 
into auxiliary services available to the child through the program, in- 
cluding a few which are directed to parents as well as the child. 



Integrating the SPEC into Programs 



It is of course to be expected that the completion of so long a 
list of questions might prove a deterrent to conscientious and thought- 
ful replies if soma procedure were not devised to increase the respondent's 
commitment. Because such evaluation does not occupy the highest position 
m the commitments of many program directors, this need for a procedure 
is further intensified. Two suggestions are offered. The properly 
completed survey should count as a substantial part of the program cr 
project final report— serving in lieu of many laboriously wrought nar- 
rative pages. A narrative final report should cover only such matters 
as are not adequately articulated within the SPEC. What these supplemental 
areas of the final report might be should be included in the program 
director's original grant proposal, in this way he would have apprised 
himself of the role of the SPEC in the evaluation of his own program and 
would understand that to neglect its completion would render his final 
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report incomplete and would hence reflect upon his contract performance. 
Only so long as evaluation is allowed to remain extrinsic to program 
function and contractual agreement will forms be filed and not returned. 
Making their completion integral to the program director' s normal functions 
would, on the other hand, encourage his thoughtful attention. 

Strengths and Limitations of the SPEC 



As persons acquainted with the strengths of particular types of 
instrumentation, we are nw£ overly impressed with survey instruments. 
Their fallibility is legendary. We have created the SPEC, a survey 
instrument, in keeping with U.S.O.E. custom of usage and in line with 
their stated desires in the request for proposal. It has become the 
fashion among researchers to lament the methodological softness of 
Federal agencies in their reliance upon the survey instrument. We see 
this agency predilection as arising from the operations of and personnel 
associated with them. These preferences are not, thus, to be easily 
turned about and redirected, since they are reflections of the total 
ecological schematization within which methodological decision making 
occurs. For us, therefore, the issue cannot simply be reduced to either 
siding totally with or totally confronting a set of data gathering prac- 
tices. We have chosen the alternative of working within this system to 
change it. That is, we have sought within the framework of a survey 
instrument to do some different kinds of things. 

First , in the suggestions of the preceding section we have pointed 
out how intrinsic motivation— or at minimum a degree of ego involvement- 
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should and can be created « Everyone knows that survey instruments are 
supposed to become more valid when this is accomplished. Federal action 
surely should be taken to create such motlvation--or else to quit sending 
out forms to be recycled as waste. Second, we have incorporated certain 
subtle features into scales that should diminish grosser forms of social 
desirability response bias by their completers. These features are in 
fact sufficiently subtle that we are not ourselves yet willing to make 
strong predictions about which of some qualitative program features will 
more favorably affect five-year-olds. Our real confidence is that several 
relevant variables for such prediction might be extractable from these 
program items. Third, we have included hard data within the survey in 
each of the major areas of variable sampling: (1) program implementation 

is to be looked at with at least one in-depth or process measure (see 
item 143); (2) a wide range of child behavioral characteristics are to 
be studied (see Items 147-152); and (3) in— depth analysis is to be 
performed using one family or community measure (see item 209). Fourth, 
it is expected that hard, criterion-ref erenced data will be gathered in 
the hallmark areas of the program, i.e.„ in areas closely linked to the 
program's distinctive goals. Provision is made for these in items 71 and 
74-77. Thus, we have produced what is still recognizable and usable as 
a survey instrument, yet which includes features which should commend it 
to those who decry survey instrument usage. 

The above recommendations for the inclusion of the three groups of 
in-depth measures cannot be lightly dismissed, because we have carefully 
documented particularly in all of Report II and Report III, Part C- 
"Recommendations" , the urgent need to have better answers to these questions. 
We have also in Report I- ,t ConcIu£ ois" , Report II-"Summary, Conclusions, 
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and Prospectus", and Report XII, Part C-""Recommendations" pointed to 
the potential boon to both programs and early childhood research that 
would result from a Federally-encouraged, closer working relationship 
between them 0 This closer working relationship would make more believable 
the capability of early childhood programs to deliver the hard data re- 
quired for the completion of SPEC developmental Items 143, 147-152, and 
209, and criterion-referenced items 71 and 74-77© It would in turn make 
more probable their being able to conduct the kind of formative evaluation 
that is also desperately needed in programs. (In this connection see 
comments on pages 20-21 of this report*)' 4. 

Survey Requirements at Other Levels 

Program data gathering forms must of course be prepared to collect 

and accumulate the information required for the SPEC’s completion*, Their 

i 

design and content readily follow from item-by-item scrutiny of the SPEC* 
At supra-program levels, other kinds of questions must be posed regarding 
the management of Title I and III programs. The kinds of questions to be 
written for them must deal with at least the following matters: What 

projections can be made that parents will participate in programs that 
plan to involve them? By what procedures is the degree of that partici- 
pation projected? Are procedures established for determining the com- 
patability of proposed curriculum with stated goals? How does the agency 
determine whether criterion measures are appropriately related to program 
goals (see items 71, 74-77 especially)? How are specific service delivery 
capabilities screened for schools submitting Title III and I proposals? 
What procedures are established to evaluate the extent of a "lobbying" 
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role of education package vendors upon particular proposal decisions? 

Is the real willingness of schools to work cooperatively with other 
community agencies being encouraged as extensively as possible through 
Title X and XXX participation? Are implementation plans screened for 
realism and precision? Are central office biases of orientation made 
sufficiently explicit in policy statements that they can be reckoned 
with objectively in the decision making process? In this last connection, 
examining a small, random sample of state-rejected proposals could provide 
information regarding the extent to which these biases might cause ac- 
ceptable innovation proposals to be overlooked. Rejected proposals would 
need to be kept on file by the original screener for some minimal period 
to make them available for such later examination. 

Finally, U.S.O.E. should consider preparing guidelines and an instru- 
ment that can be used to consensually validate the so-called "content 
validity" of criterion referenced measures. At present much of this 
judging is done loosely by persons who have never been trained or personally 
standardized as judges of the", content validity of those areas in whi.ch 
they are operating. Their work appears highly subjective. The creation 
of a reconmended procedure and forms for field use would probably elevate 
considerably the quality of criterion reference measures. It would also 
curb some instantaneous but questionably professional, criterion-referenced 
expertise which has recently gained entry into the inner sanctums of 
educational innovation. We contend that judging content appropriateness 
is worthy of having its own validating procedure. It will no longer do 
to accept boldly dropped disclaimers— presumably on grounds that psycho- 
metric standards are not applicable to such devices. Although traditional 



psychometric standards are strained by such instruments s what should 
be equally clear is chat the need for objectivity has not suddenly been 
suspended. 



59 



SURVEY OOF PROGRAM in early CHILDHOOD (SPEC): 
FOR TITLE I OR III EVALUATION 



Directions : Complete applicable parts, following guides provided. 

Use overflow sheet as often as needed by entering symbol Cf at the end 
of any line that Is to be continued. Follow it with the number of the 
entry that is to be continued. Keep all entries on overflow sheet (s) 
numbered and sequential by this same code. A separate SPEC is to be 
completed for each separate grant for program or project. SC is used 
thr oughout for Early Childhood. Where answer options are pre -stated 
CIRCLE the most accurate choice or CIRCLE multiple choices where ap- 
plicable. 



1. Program Director or Other Person completing SPEC. (If other than 
Director, indicate relationship to program.) : 



2. Program or Project name: 

3. Where located- "Street Address: 

4. Where located— City, State, Zip: 

Program Characteristics . General 

5. Title I, Title III? 

6. Program's or Project's distinctive features (25 word maximum): 



7. Program or Project goals (list by codes from Guide I; these may be 
supplemented with brief qualifying remaxks; be sure to use overflow page 
if Guide I could not be used or space here is insufficient) : 



8. If your program or project has multiple phases, this report covers: 
Not Applicable Planning Phase Pilot Phase 




68 



Operational Phase 



Program Indicators . General 

9. Per child annual EC expenditure by school on equipment and materials: 



10. Nap facilities available: Cots Mats Other (Specify) 



None 



11. Total square feet of indoor space reserved for this EC activity: 



12. Total square feet of outdoor space reserved for this EC activity:_ 
. If not reserved, but separately scheduled, indicate total 



daily hours avilability_ 
rating scheduled time.s__ 



and longest time interval sepa- 



13. Are separate toilet facilities available for your EC component? 

Yes 

14. Is running water available in each EC classroom? 

15. Are supervisory persons available to EC teachers and/or aides? 

Constantly On Call Regular Intervals Irregular Intervals Never 
16A. Art teacher is available: Regularly Irregularly Never 

16B. Music teacher is available: Regularly Irregulary Never 

16C. Ratio (Number of EC teachers and aides/ children) : / 



Yes 

No 



Program Indicators . Qualifications , and Schedule 

17A. Number of certified EC teachers : 

17B. Number of temporary or emergency certified teachers : 

17C . Number of aides with less than high school: 

D. high school graduates: E . some colleg e 

F. college graduates: 

Yea 

17G. Boss length of school day vary? 

Specify length (s) of school day and number of children involved said days: 
length number days per weak 
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Program Indicators , Outdoor Equipment 

Indicate all applicable outdoor equipment regularly available by making 
a check after A and check by B for impx*ovemezits: 

A vailable Improveme .'fc due to_ thi s 

gran t 



13. 


Climbing apparatus 


A 


B 


19. 


Garden area 


A 


B 


20. 


Outdoor playhouse 


A 


B 


21. 


Sand box or area 


A 


B 


22. 


Slide 


A 


B 


23. 


Swings 


A 


B 


24. 


Teeter totter 


A 


B 


25. 


Wheel toys 


A 


B 


26. 


Total of different M A n 


types 


Total "B* 1 Improvements 




circled in 18-26: 


A 


18-26; B 


27. 


Other equipment: 







Pr^^ ram Indicators , Indoor Equipment 

jLii . ce all applicable indoor play equipment and supplies regularly 
able with a check beside A and check by B for improvements: 

Available Improvement due to this 

grant 



28, 


Adult dress up clothes 


A 


B 


29. 


Baby carriage 


A 


B 


30. 


Clay or plasticene 


A 


B 


31. 


Collection of picture books 


A 


B 


32. 


Construction paper 


A 


B 


33. 


Dishes 


A 


B 


34. 


Dolls 


A 


B 





" ® 


Housenold furniture 


A 


B 


36. 


Iron and ironing board 


A 


B 


37. 


Kitchen appliances 


A 


B 


38. 


Large hollow blocks 


A 


B 


39. 


Nature study (e.g., pet 
cages , aquarium) 


A 


_ B 


40. 


Paints 


A 


B 


41. 


Paste and scissojcs 


A 


B 


42. 


Puppets 


A 


B 


43. 


Puzzles (include packaged 








perceptual learning games) 


A 


B 


44. 


Record player and records 


A 


B 


45. 


Rhythm instruments (or 
other musical) 


A 


B 


46. 


Simple games 


A 


B 


47. 


Small blocks 


A 


B 


48. 


String or pull toys 


A v 


B 


49. 


Table toys 


A 


B 


50. 


Tumbling mats 


A 


B 


51. 


Vacuum or sweeper 


A 


B 


52. 


Weaving materials 


A 


B 


53. 


Woodworking 


A 


B 


54. 


Total of different "A 11 types 




Total "B" Improvements 




circled in 28-54: 


A 


28-54: B 


55. 


Other equipment; 








Program Indicators. Grouping 

56. What is your basis of grouping 

Age Locality Test Scores Other (Specify) 
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No grouping used 
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57. What ages of children are placed in a single group? 

4 4% 5 5% 6 



3% 



Yes 



58. Have you special or remedial groupings s No 

59. If Yes for 58 , describe basis: _ 



60. In what size group do children usually receive instruction?,, 



(Note: Arrange 61-64 to equal 100% total. All refer to "Indoor Learning".) 

61. What percentage of indoor time is spent in large group (6 or more) 
ins true t ion ? — — 



62. Small group (1-5) ins true ion? — 

63. Small peer group or individual activity: teacher directed?, 

64. Small peer group or individual activity: self selected? 



P ro gram Indicators , Evalurt jon and Repo r t ing 

65. Do parents of each child supply basic developmental information to 
Yes 

the school? 



No 



66. Length of interview or questionnaire in 65: 
items of information) 

67. Are basic health records kept for each child? 



(Number of different 



Yes 

No 



Yes 



68. Are individual cumulative records kept for each child? No 

69. At what intervals are reports made to parents? 

70. How is reporting accomplished? 

Written Checklist Conference Other (Specify) 



7li At what average intervals per child are informational notations made 
by the teacher or aide? 



Weekly Monthly Quarterly Other (Specify). 

Yes 

72, Are diffusion effects evaluated? N 



u4 



73. If Yes for 72,, describe procedure: 



Yes 

74* is systematic observation of children used? 

No 

75. If Yes for 74, of what characteristic (s) (Code by Guide I)? 



76. Are formal evaluation devices used, other than those contractually 

Yes 

(See #147-152) specified as part of your Title I or III evaluation? jjo 

77. If Yes for 76 . of what characteristic (s) (Code by Guide I)? 



Program Indicators . Orientation 

Indicate for 78-94 the percentage contribution of each program orientation 
that guides your thinking and planning. These should total 100%. 



• 

00 

rv 


British infant school type 


79. 


Creativity, originality, divergent thinking 


o 

00 


Diagnostically based 


81. 


Head Start or other group compensatory 


e 

CNl 

00 


Imitative behavior, modeling 


83. 


Learning to learn, cognitive strategies 


84. 


Maternal teaching; family effectiveness 


85. 


Montessori 


86. 


Operant or other reinforcement based 


0 

00 


Peers as teachers or tutors 


88. 


Piagetian based 


89. 


Reading or number based readiness 


90. 


Responsive environment 


91. 


Socialization, psychoanalytic or drive management 


92. 


Specific deficits (structured), Frostig, Bereiter-Englemann, 
Academic 
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9 3. Specific deficits (unstructured), DARCEE, Ameliorative 
94. Traditional or nursery school 

95. Describe in your own terms the major features of your own program's 
orientation (up to 25 words) t _____________ 




O 

ERJC 



Fr o gram Indicators Activities 

Show the approximate percentage of classroom time consumed in your program 
by each of the following learning activities. Your estimates should total 
100% for 96-138. It will be easier if you begin by checking off and then 
fill in percentages. 

9 6« Attentional and motor control gmnes (Simon says) 

97. Audio recording of children 

9 8. Caring for plants or animals 

99. Classification, matching* discrimination 

100 . Clean up 

101 » Construction with paper, cardboard, expendables 
1 02 * Copying, lettering 

1 03. Creative dramatics 

1 04. Culture enrichment 

_JL05. Directed gross motor activity 

1 06a Discussion, planning, questioning, sharing 

X07o Dramatic play 

108 • Drawing 

1 09 0 Fantasy supported ind ..vidua „ act vit rj 

1 10 a F^lk games 

^ 111. Large motor construction 

112. Listening to stories 
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113. 


Mo ther -eh ild in t er ac t ion 




114. 


Musical gCTies 




115. 


Outdoor free play 




116. 


Outdoor group play activity 




117. 


painting 




118. 


Programmed ins true t ion 




119. 


Repeating or verbal copying 




120. 


Resource persons to classroom 




121. 


Rhythm activity 




122. 


Sand play 




123. 


Science experiments 




124. 


Sequential lessons (packaged) 




125. 


Seriation, counting, equating groups 




126. 


Settling down after activity change 




127. 


Supervised rest 




128. 


Time o. process related concepts 




129. 


Trips 




130. 


Typing 




131. 


Video viewing 




132. 


Vocabulary development 




133. 


Water play 




134. 


Wood working 




135. 


Work sheets 




136. 


Other 




137. 


Other 


4 


138. 


Other 
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Program Indicators - Tmpl pmontation 

Check each of the following which was used this year systematically or 
on a planned basis to assure specific implementation of your program 
orientation (refer to 95) ; 

_139„ Demonstration by helping teachers 

__140 . In-service training, other 

1 41a Observation with feedback 

1 42. Simulation, microteaching 

143. What in-depth indicator(s) have you used to verify whether program 
implementation is proceeding according to your plan? (See A-3 and A-4 
in "Matches" on this) Explain: 



Child Population Served 

144. Age (Numbers): 

^ ■ . 3% . C. 4 . D. 4% . E. 5 

Fo 5%_ , G. 6 

145. Sex (Numbers): 

A. Boys B. Girls 

146. Ethnicity (Numbers): 

A. Negro , b. Angl o . C. Spanish Surnam e . 

D. Indian , E. Orienta l F. Othe r G. Other 



Behay io ral Character i s tics Studied (2 different per behavior domain coded 
after Guide I) 

Records are to be kept for 147-152 for each distinguishable, involved 
demographic subgroup of children, which is identified in the U.S.O.E. 
guidelines regarding demographic records, at the time intervals which 
have been specified in your proposal. These are to be reported following 
each assessment as a part of your regular progress reporting. 

147. P- (From P-0, P-4, P-6, P-7) 
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148 . 


P- 


(Front P-0, P-4, P-6, F-7) 






149. 


c« 


(From C-l, C-2, C-5, C“8) 






150. 


c- 


(From C-l, C-2, C-5, C-8) 






151. 


A- 


(From A- 7 ff. gp, , A-10, A-27 


ff. gp., A-33 ff. gp., 
ff. gp., A-33 ff. gp 


A-36) 

A-36) 


152. 


A- 


(From A- 7 ff c gp.. A-10 % A-27 



Children Receiving Services by School Designation 
Numbers All Non-Public 

153 . Cooperative nursery school 
154 o Cooperative kindergarten 

_155. Private nursery school 

_156. Private kindergarten 

157o Day care 

158. Parochial nursery school 

1 59 . Parochial kindergarten 



Numbers 



161. 

162 . 



faM 1c. 

Nursery school 

Kindergarten 

Ccmspunity 



Family -Copwaupity Factors 

Child socioeconomic level (use Guide II) . 

Number 



163. 

164. 



165 * 



High 
Medium 
Upper lower 
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166. Lower lower 
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167. Number of children from homes in which a language other than 
English is spoken; 

168. Number of children who share a bed; 

169. Average number of siblings at home; 

170. Average number of persons in home other than parents and sibling; 

171. Average number from 170 who are not related to the child; 

Number in each type residential area: 

Number 

172* Single family 
173<* Duplex 

174. Apartment 

175. Subsidized project 

176 • Heavily congested ____ 

Residential location: 

Number 

177 • Rural or small town 
178. Suburban 

179 * Inner city 

180. Migrant 

181. Mean duration of residence (years and months) : 

Number by family unity; 

Number 

Intact (both own parents) 

Reconstituted (one parent 
and one stepparent or 
adopted) 

' 78 



182 . 

183 . 
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184. Broken (one parent only) 
185 e Placement (foster) 



child)° f parental education » (count parent living with child or supporting 



186. 


Less than high school 


Father 5 Number 
A 


Mo ther * Number 


187. 


High school 


A 




188. 


Some college 


A 


B_ 


189. 


College graduate 


A 


B 


Occupational condition of parent 


. (For occupational level see 163- 






Father i Number . 


Mother, Number 


1 90. 


Disabled 


A 


B 


191. 


Unemployed 


A 


B 


192. 


Deceased 


A 


B 


193. 


Employed 


A 


B_ 


194. 


Homemaker 


A 


B 



Recreation area available to children outside the home: 

Number 

195* Scheduled play area or yard 

196* Project or public play area _____ 

197. Vacant lot 

198. Streets 

199. List objects majority of children typically have to play with at 
home : 






200.. How many children are exposed at home to serious physical or 
sanitation hazards? 



71 



201. How many children are exposed at home to models of violence? 

202. How many children are exposed in the home and neighborhood to 

intimidation, threats of or overt violence? 

203. How many children have regular meal times at home? 

204. How many children have regular sleeping times at. home?_ 

205. How many children are frequently left with multiple care-takers? 



206. Is there an effective Community Action Program or other similar 

Yes 

agency in the child's neighborhood? 

° Yes 

207. Do school and community have several areas of cooperation? 

208. Specify areas for 207: 



209. What in-depth analysis are you performing on a family or community 
factor? (See Guide I A-48 and A-4 9) Explain: 




Other Services Provided Through Program (All that apply) 



210. 


Dental examination 




Yes 


No 


211. 


Dental treatment 




Yes 


No 


2X2 o 


Dental hygiene instruction 


Yes 


No 


213. 


Medical examination 




Yes 


No 


214. 


Medical: physician 


on call 


Yes 


No 


215. 


Medical treatment 




Yes 


No 


216. 


Medical prosthesis: 
vision 


hearing. 


Yes 


No 


217. 


Nurse available 




Yes 


No 
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218. 


Parental: Instruction, child 

development 


Yes 


No 


219. 


Parental: home* vis tor or 

volunteer 


Yes 


No 


220. 


Psychological evaluation 


Yes 


No 


221. 


Social services: casework 


Yes 


No 


222. 


Speech evaluation 


Yes 


No 


223. 


Speech therapy 


Yes 


No 


224. 


Nutritional: 


breakfast 


Yes 


No 


225. 


Nutritional: 


lunch 


Yes 


No 


226. 


Nutritional: 


snacks 


Yes 


No 


227. 


Nutritional: 


milk 


Yes 


No 


228. 


Volunteers: 


conmunity 


Yes 


No 


229. 


Volunteers: 


teens 


Yes 


No 


230. 


Volunteers: 


parents 


Yes 


No 


231. 


Parents Involved as teacher aides 


Yes 


No 


232. 


Parents involved in basic program 


Yes 


No 


233. 


If 232 is Yes, describe: 
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Coding Guide 



Guide #1 



4 



3 



2 



1 



This guide is listed in its fully expanded form in this report as 
coded outline for "Matches”, Part C, pp. 5-13. 



Upp.er-^ Jhildren of administrators, executives, jiJ.^iaar level pro- 
fessionals, entertainers, military commanders, higher level poli- 
ticians, independently wealthy. Many samples designated "high" 
are really middle class. Income will not be used, since the 'index 
varies from time to time. 

Middle— Sffill business owners, foremen, white collar workers, larger 
farm operators, middle and lower level professionals, some service 
workers (more subtle factors separate these into UL and Middle), 
technicians, engineers. These persons are usually salaried. 

UL— Upper lower class— Blue collar workers (may have as high or 
higher income than white collar but are "working class" oriented) , 
small farmers, tradesmen, semi-skilled, many service workers (e.g., 
laundry, food service), truckers. These persons usually work for 
wages. Some of the "technically" disadvantaged fit here. 

LL— Lower lower class— Unskilled or minimally skilled workers, 
the unemployed, many of the disabled, the tenant farmers, migrants, 
welfare families. Lower lower is perhaps best understood as in- 
volving a style of life created by the uncertainties and tensions 
P over ty and the traits cf instability, restlessness, external 
locus of control, apathy, and a sense of powerlessness. 



Guide #2 

Socioeconomic Level 



Code 
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PART E-- 

SAMPLING RECOMMENDATIONS OR GUIDELINES 



oo 
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SAMPLING RECOMMENDATIONS OR GUIDELINES 

Most of the decisions affecting this part of the final report of the 
project. Literature Search and Development of an Evaluation System in 
Early Childhood Education, have already "been anticipated. Particularly 
in the "Recommendations" portion of Part C and in Part D on the survey 
instrument, the general directions of these guidelines have already been 
sketched in. Because the rationale for them is already contained within 
the covers of this report, it will "be sufficient here to reiterate them in 
systematic fashion. This will be done in terms of the sequence of phases 
implied in the prior recommendations. To accomplish U.S.O.E.'s stated 
purposes in such a longitudinal study, attention must be given to two 
areas of sampling: variables and cases. Since variables sampling was 

already systematically detailed in Part D, further mention of this 
problem will be avoided here. Unfortunately, as in the case of Part D, 
our present belief is that U.S.O.E. no longer has plans to use these 
guidelines directly for sampling. We are, nevertheless, providing them. 

The concerns of this part are with a systematic presentation of 
gui delines for the sampling of cases. These guidelines are arranged to he 
congruent with all of our earlier recommendations of the needs for hoth 
measurement development and evaluation work. The guidelines sire shown 
schematically in Figure I below in terms of the sampling requirements that 
are particular to the various phases of U.S.O.E.'s future measurement 
development and evaluation efforts. It will be evident that Phase I refers 
to a major thrust in normative demographic sampling and Phase II to the 
ongoing national needs for program evaluation. In Phase II differentiated 
pathways are indicated for one longitudinal panel and another for the 

84 




76 



remainder of* Title I and Title III evaluation. Further subdivisions are 
indicated where required with reference to measures of parent or of 
classroom variables. 





77 



Pig are I 

Sampling of Cases by Phase of the 
National Normative and Evaluation Studies 



Phase I 



Tasks : 



(A) Complete national demographic subgroup normlng 
and validation of behavioral tests for five- 
year-olds (repeat norming periodically) . 

(B) Further development of parent measures. 

(C) Further development of classroom delivery measures. 

(D) improvement of criterion-referenced test development 
procedures . 



Sampling ; 



(A) Systematic and extensive as outlined in Report III* 

Part C. _ . . 

(B) Constitute • a small longitudinal panel from group in A. 



Analyses t 



(A) Demographic group validity; normative developmental 
curves for groups* 

(B) Preliminary cluster analyses of program character- 
istics (SPEC). 

(C) Inter-domain correlational analyses. 

(D) Validity analyses for parent measures. 

(E) Validity of classroom delivery measures. 



Phase II 



Tasks ; 



(A) Continued monitoring of developmental panel for 
long-term effects. 

(B) More refined treatment of criterion-referenced 
test development. 

(C* Periodic and annual progress evaluation for 

specific programs for delivery systems and products. 

(D) Monitor development of new criterion-referenced 
tests for different child subgroups. 



Sampling : (A) Small panel longitudinal follow-up study by demo- 

graphic categories (See Part D, Report III) . 

(B) Within-program summative evaluation for all programs , 
but with reduced data collection needs and minus 
control groups. 

(C) Pretest new criterion-referenced tests within pro- 
grams under positive reactive conditions; posttest 
with pretest as covariate. 
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(D) Administer new or revised developmental, family, 

and program delivery measures selectively and hold 
over for periodic renorming activity* 



Analyses ; (A) Longitudinal panel for all interrelationships • 



(B) Within-program summative for gains 

(C) Validity analyses of new criterion-referenced 
measures * 

(D) Validity of new developmental, family, and program 
delivery measures * 
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